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Abstract of JP 2000148748 (A) 

PROBLEM TO BE SOLVED: To insert an image on a 
word processor, etc., by displaying images together with 
KANJI(Chinese character) candidates like KANJI without 
any switching between KANA-KANJI conversion and 
image retrieval. SOLUTION: A picture character dictionary 
12 contains readings and image file names corresponding 
thereto. When a character string is inputted from an input 
means 5, conversion candidates for KANJI are obtained 
from a KANA- KANJI converting means 4 and a KANJI 
dictionary 13. A picture character retrieval means 3 
obtains all KANJI conversion candidates and readings 
from the KANA-KANJI converting means 4 and preforms 
retrieval based upon a reading from the picture character 
dictionary 12.; When an image file corresponding to the 
reading is found, the KANJI conversion candidates and 
images are displayed together by a candidate list display 
means 22 and a selected character is displayed by a 
character and image display means 21. 
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[0008] 

5 [Embodiments] Hereinafter, a first embodiment of the present invention will be 

described in detail with reference to the accompanying drawings. Referring to Fig. 1, a 
first embodiment of an image retrieval display system using Kanji conversion according 
to the present invention operates on a program-controlled computer (central processing 
unit; processor) 100, and includes: storage means 1 for storing information; display 

10 means 2 for displaying information; program-controlled Emoji (picture character- 
symbol retrieval means 3; Kana-Kanji conversion means 4 providing a Kana-Kanji 
conversion function; and input means 5 formed by a keyboard or the like. The storage 
device 1 includes image file storage means 11, an Emoji-symbol dictionary 12, and a 
Kanji dictionary 13. The display device 2 includes character/image display means 21 

15 and candidate list display means 22. 

[0009] The image file storage means 1 1 stores image files. The Emoji-symbol 
dictionary 12 pre-stores a correspondence table of character strings and image file 
names. The Kanji dictionary 13 is a Kana-Kanji conversion dictionary which is used by 
the Kana-Kanji conversion means 4, and holds a correspondence table of alphabets or 

20 readings of Japanese characters and corresponding Kanji characters. The 

character/image display means 21 has a function capable of displaying characters and 
images simultaneously. The character/image display means 21 displays characters 
when the Emoji-symbol retrieval means 3 gives character information to the 
character/image display means 21 . When the Emoji-symbol retrieval means 3 gives a 

2 5 file name to the character/image display means 2 1 , the character/image display means 2 1 
reads an image file from the image file storage means 1 1 and displays an image. The 
candidate list display means 22 receives a plurality of image file names and a plurality of 
Kanji conversion candidate character strings, and displays characters and images in the 



form of a list. The Emoji-symbol retrieval means 3 receives Kanji conversion candidate 
character strings, a first conversion candidate character string, an input character string, 
and a conversion state indicating "converting" or "confirmed" from the Kana-Kanji 
conversion means 4, and performs retrieval in the Emoji-symbol dictionary 12 by using 
5 the input character string. If there is an image file name corresponding to the input 
character string, the Emoji-symbol retrieval means 3 obtains the image file name. The 
Kana-Kanji conversion means 4 stores a character string received from the input means 
5 . When a "conversion" key is pressed, the Kana-Kanji conversion means 4 retrieves a 
Kanji character string corresponding to the input character string from the Kanji 

10 dictionary 13, and gives all the matching conversion candidate character strings, a first 
conversion candidate character string which is a first candidate of Kanji conversion, and 
the input character string to the Emoji-symbol retrieval means 3 . The Emoji-symbol 
retrieval means 3 has candidate character string storage means 3 1 for temporarily 
holding a character string that is input from the input means 5 in an input mode. 

15 [001 0] The Kana-Kanji conversion means 4 sends a message of" inputting," "start 
conversion," "next candidate," or "confirmed" to the Emoji-symbol retrieval means 3 
according to input from the input means 5. 

[001 1] A conversion candidate list which is given to the candidate list display means 22 
is in the form of, for example, a table which is formed by items having a mode and a data 
20 region as shown below. In the following example, the items have Kanji data when the 
mode value is 0, and have a bitmap file name when the mode value is 1 . 

o Stf 

o m 

0 m 

25 1 sake.gif 

1 wine.gif 

The candidate list display means 22 checks the mode value and performs corresponding 
processing. 
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[0012] Hereinafter, overall operation of the first embodiment will be described in detail 
with reference to Fig. 1 and the flowcharts of Figs. 2, 3, and 4. 

[0013] Fig. 2 is a flowchart illustrating operation of the Kana-Kanji conversion means 4. 
The Kana-Kanji conversion means 4 monitors the input means 5 (Al), and when the 
5 "conversion" key is pressed (A2), sends a message of "start conversion" to the Emoji- 
symbol retrieval means 3 (A3), performs Kanji retrieval in the Kanji dictionary 13 by 
using an input character string (A4), and sends a list of a first conversion candidate 
character string and conversion character strings to the Emoji-symbol retrieval means 3 
(A5). When a "next candidate" key is pressed (A6), the Kana-Kanji conversion means 

10 4 sends a message of "next candidate" to the Emoji-symbol retrieval means 3 (A7). 
When a "confirm" key is pressed (A8), the Kana-Kanji conversion means 4 sends a 
message of "confirmed" to the Emoji-symbol retrieval means 3 (A9) and clears the 
candidate character string storage means 3 1 (A10). When any other keys are pressed, 
the Kana-Kanji conversion means 4 sends a message of "inputting" to the Emoji-symbol 

15 retrieval means 3 (Al 1), additionally stores an input character string from the keys in the 
candidate character string storage means 3 1 (A12), and sends the input character string 
stored in the candidate character storage means 3 1 to the Emoji-symbol retrieval means 
3 (A13). 

[0014] Fig. 3 is a flowchart illustrating operation of the Emoji-symbol retrieval means 3 
20 and the display means 2. The Emoji-symbol retrieval means 3 waits for input from the 
Kana-Kanji conversion means 4 (B 1). When the Emoji-symbol retrieval means 3 
receives a message of "inputting" (B2), the Emoji-symbol retrieval means 3 displays 
input characters on the character/image display means 21 (B3). When the Emoji- 
symbol retrieval means 3 receives a message of "start conversion" (B4), the Emoji- 
25 symbol retrieval means 3 performs retrieval in the Emoji-symbol dictionary 12 by using 
the input character string (B5), and obtains a list of matching image file names (B6). 
The Emoji-symbol retrieval means 3 makes a list containing the following: the image file 
names obtained from the Emoji-symbol dictionary 12; a first conversion candidate 
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character string; a list of conversion character strings; and a list of image files (B7), and 
gives the list to the candidate list display means 22 (B8) to display a candidate list on the 
candidate display means 22 (B9). The Emoji-symbol retrieval means 3 obtains the first 
conversion candidate character string from the candidate list display means 22, and 
5 displays the obtained character string at a designated character display position on the 
character/image display means 2 1 (B8). When the Emoji-symbol retrieval means 3 
receives a message of "next candidate" (BIO), the Emoji-symbol retrieval means 3 
instructs the candidate list display means 22 to highlight the next candidate (Bl 1) and 
obtains the character string selected in the candidate list display means 22 (B 12). The 

10 Emoji-symbol retrieval means 3 deletes the first conversion candidate displayed on the 
character/image display means 21, and displays the next candidate character or image on 
the character/image display means 2 1 (B 13). When the Emoji-symbol retrieval means 
3 receives a message of "confirmed" (B9), the Emoji-symbol retrieval means 3 deletes 
the data in the candidate list display means 22, confirms the character displayed on the 

15 character/image display means 21, and sets a new character display position (BIO). 

[0015] Fig. 4 is a flowchart illustrating operations of the candidate list display means 22. 
The candidate list display means 22 receives a conversion candidate list and a selected 
character string from the Emoji-symbol retrieval means 3 (CI), and displays a list box 
capable of selective display (C2). The candidate list display means 22 draws each item 

20 of the list box, and when finished drawing all items (C3), highlights the selected 
characters (CI 4) and waits for a request from the Emoji-symbol retrieval means 3. 
When the item is a bitmap (C4), the candidate list display means 22 obtains bitmap data 
from the image file storage means 1 1 (C6) and displays an image (C7). When the item 
is characters, the candidate list display means 22 displays a character string (C5). 

25 When the candidate list display means 22 receives a request for the selected image string 
(CI 2), the candidate list display means 22 returns the highlighted character string or an 
image file name (CI 3). When the candidate list display means 22 receives a request to 
move to the next item (C8), the candidate list display means 22 selects a different 
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character string (C9) and highlights the selected character string (C 1 4). When the 
candidate list display means 22 receives a request to confirm (CIO), the candidate list 
display means 22 deletes the list box (CI 1) and ends its operation. In an example of 
the candidate list display, Kanji characters and images are displayed in the same 
5 candidate list as shown in Fig. 5, and the reversed part indicates a selected character. 
Alternatively, the candidate list may be a horizontal list as shown in Fig. 10. 
[0016] Hereinafter, effects of the present embodiment will be described. In the present 
embodiment, conversion can be performed without switching between Kana-Kanji 
conversion and image retrieval, and a Kanji character and an image can be displayed or 

10 inserted by the same user interface as that for the Kana-Kanji conversion function. In 
the case of a Kana-Kanji conversion system capable of giving candidate character strings, 
an input character string, and the like to an application, such as the input method editor, 
the Kana-Kanji conversion means 4 may be replaced with Kana-Kanji conversion 
software which is an external application. 

15 [0017] The character/image display means 21 may also be replaced with a word 

processor capable of displaying Japanese characters and images and capable of inserting 
and deleting characters and images from outside. 

[0018] Moreover, in the present invention, a first conversion candidate character string 
and a conversion candidate list are sent simultaneously when the "conversion" key is 

20 pressed. In some types of Kana-Kanji conversion software, a list of conversion 

character strings is not sent unless the "conversion" key is pressed a plurality of times. 
In this case, it is possible that the Emoji-symbol retrieval means 3 neither performs 
image retrieval in the Emoji-symbol dictionary 12 nor displays a candidate list on the 
candidate list display means 22, but displays a first conversion candidate character string 

25 on the character/image display means 21, until the Emoji-symbol dictionary 12 receives 
the list of conversion character strings. 

[0019] Moreover, in the present embodiment, image retrieval is performed in the Emoji- 
symbol dictionary 12 by using an input character string. However, the present 
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invention is not limited to this, and image retrieval may be performed by using a 
conversion candidate character string. 

[0020] Hereinafter, an operation of the first embodiment of the present invention will be 
described by using a specific example. As shown in Fig. 7, when a character string " £ 
5 W is input to the input means 5, the Kana-Kanji conversion means 4 sends this 

character string directly to the Emoji-symbol retrieval means 3, and displays "&ltf" on 
the character/image display means 22 as shown in Fig. 7(a). It is herein assumed that 
the characters "&3 V ^ L V v ' have already been confirmed in Fig. 7(a). When the 
"conversion" key is then pressed by the input means 5, the Kana-Kanji conversion means 

10 4 performs retrieval in the Kanji dictionary 13 and obtains a first conversion candidate 
"ffl" and conversion candidate character strings such as "HI" and ." The Kana- 
Kanji conversion means 4 then sends the first conversion candidate and the conversion 
candidate character strings together with the input character string " £ Gt" to the Emoji- 
symbol retrieval means 3. The Emoji-symbol retrieval means 3 performs retrieval in 

15 the Emoji-symbol dictionary 1 2 by using the input character string " £ (t ." When 
character strings such as "waiagif," "nihonshu.gif," "cocktail.gif," and "beer.gif ' are 
returned, the Emoji-symbol retrieval means 3 sends these character strings together with 
the above conversion candidate character strings to the candidate list display means 22. 
In the case of file names, the candidate list display means 22 obtains image data from the 

20 image file storage means 1 1 and displays a list containing the conversion candidate 

character strings and images as shown in Fig. 7(b). The character/image display means 
21 deletes the characters " £ ft" and displays the first conversion candidate character 
"M" instead. When the "next candidate" key is pressed, the first conversion candidate 
character changes to "§£" and the reversed part of the list moves to "IS," and the 

25 character/image display means 21 deletes "W and displays instead. When 
conversion is repeated similarly and "wain.gif " is selected as shown in Fig. 7(c), the 
character/image display means 21 obtains image data from the image file storage means 



-6- 



1 1 and displays as shown in Fig. 7(c). When the "confirm" key is pressed by the input 
means 5, a character or an image is confirmed, and the image retrieval display system 
waits for the next input. 

[0021] Hereinafter, a second embodiment of the present invention will be described in 
5 detail with reference to the figures. Fig. 6 shows the second embodiment of the image 
retrieval display system using Kanji conversion according to the present invention. The 
second embodiment is different from the first embodiment in that the image retrieval 
display system of the second embodiment further includes: phrase information storage 
means 2032 for holding phrase character strings and phrase information which are sent 

10 from the Kana-Kanji conversion means 4; declensional-Kana-ending separation means 
2033 for removing a predetermined declensional Kana ending and performing retrieval 
in a Emoji-symbol dictionary 2012; and image/character combination display means 
2023 for displaying candidate list items which combine images and characters. The 
second embodiment is different from the first embodiment also in that Kana-Kanji 

15 conversion means 204 is formed by Kanji retrieval means 2041 and phrase dividing 
means 2042. 

[0022] Hereinafter, an overall operation of the present embodiment will be described in 
detail with reference to Fig. 6 and the flowchart of Fig. 9. Since the basic operation is 
the same as that of the first embodiment, only the differences from the first embodiment 

20 will be described herein. The phrase dividing means 2042 first divides an input 

character string from input means 205 into a plurality of phrases (Dl) and sends the 
plurality of phrases to the Kanji retrieval means 2041 . The Kanji retrieval means 204 1 
performs Kanji retrieval in a Kanji dictionary 2013 on a phrase-by-phrase basis (D2), 
and sends a character string of a first conversion candidate of each phrase, phrase 

25 boundary information, and a reading of each phrase to Emoji-symbol retrieval means 
203 (D3). For the first phrase which is a target phrase to be converted, the Kanji 
retrieval means 2041 obtains a second conversion candidate and the following 
conversion candidates from the Kanji dictionary 2013, creates a conversion candidate 
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list (D4), and sends the conversion result to the Emoji-symbol retrieval means 203 . 
The Emoji-symbol retrieval means 203 stores the phrase information in the phrase 
information storage means 2032 (D5), and sends a reading of a target phrase to be 
converted to the declensional-Kana-ending separation retrieval means 2033 (D6). The 
5 declensional-Kana-ending separation retrieval means 2033 has declensional Kana 

endings such as "&r," "CO," and The declensional-Kana-ending separation 

retrieval means 2033 checks the last character of the reading, and if the last character 
matches with one of the registered declensional Kana endings (D7), performs retrieval in 
the Emoji-symbol dictionary 2012 by using a word without the last character (D8, D9). 

10 When a file name is returned as a retrieval result (D10), the declensional-Kana-ending 
separation retrieval means 2033 returns the file name and the declensional Kana ending 
that was removed for the retrieval operation to the Emoji-symbol retrieval means 203 
(Dl 1). The Emoji-symbol retrieval means 203 combines the file name with the 
declensional Kana ending, adds the combination to the conversion candidate list, and 

1 5 gives the resultant conversion candidate list to candidate list display means 2022 (D 1 2). 
If the candidate list contains an image file name and a declensional Kana ending (D13), 
the candidate list display means 2022 obtains an image from the image file storage 
means 201 1 (D 14), and sends the image and the declensional Kana ending to the 
image/character combination display means 2023 to display the image and the 

20 declensional Kana ending together in the candidate list (D 1 5). The Emoji-symbol 

retrieval means 203 obtains the selected character string from the candidate list display 
means 2022 and obtains conversion candidate character strings of another phrase stored 
in the phrase information storage means 2032 (D16), and sends the selected character 
string and the conversion candidate character strings to a character/image display means 

25 2021 for display in combination (D17). 

[0023] The Kana-Kanji conversion means 204 may be replaced with an external 
application which divides a character string into phrases, performs Kana-Kanji 
conversion on a phrase-by-phrase basis, and sends phrase information and candidate list 



information. An example of such an external application is the input method editor. 
[0024] The second embodiment thus uses Kana-Kanji conversion including the process 
of dividing a character string into phrases. Accordingly, even if an input character 
string has a phrase including a declensional Kana ending, the declensional Kana ending is 
5 removed and image retrieval can therefore be performed in a word-based Emoji-symbol 
dictionary. Moreover, an image containing the declensional Kana ending can be 
displayed in the conversion candidate list. 

[0025] Hereinafter, operation of the second embodiment of the present invention will be 
described by using a specific example. As shown in Fig. 8(a), when the character string 

10 " § ft & ft V ^ L V v is input by the input means 205 and the "conversion" key is pressed, 
the phrase dividing means 2042 divides the input character string " $ ft & ft I ^ L V v 
into two phrases " £ ftW and "ft I ^ L-1 v ' and sends each of the phrases to the Kanji 
retrieval means 204 1 . The Kanji retrieval means 204 1 performs retrieval in the Kanji 
dictionary 2013. As a result, "rg^" and "ft V > L V v ' are obtained as respective first 

15 conversion candidates of the phrases, and other conversion candidates of the first phrase, 
such as "i£ " and " f - *T 1$ ," are also obtained from the Kanji dictionary 20 1 3 . The 
Kanji conversion means 2041 stores respective readings of the phrases, " £ ft ft" and 
"ftV^ Ll\" the respective first conversion candidates "Mff" and "ftV^ LV\" and the 
conversion candidates of the first phrase, such as and "f-^V in a list, and 

20 sends the list to the Emoji-symbol retrieval means 203 . The Emoji-symbol retrieval 
means 203 reads the reading of the first phrase, " £ ft ft" to the declensional-Kana- 
ending separation retrieval means 2033 . Since the last character of" $ ft matches 
with the registered declensional Kana ending V the declensional-Kana-ending 
separation retrieval means 2033 removes "#*" from the phrase " £ ftff," and performs 

25 retrieval in the Emoji-symbol dictionary by using " $ ft."' The declensional-Kana- 
ending separation retrieval means 2033 then returns the retrieval result "sake.gif ' and 
the removed declensional Kana ending to the Emoji-symbol retrieval means 303. 



The Emoji-symbol retrieval means 203 adds the bitmap and the Kana character to the 
conversion candidate list as an item. When the list has an item having a bitmap, the 
image/character combination display means 2023 produces image data by combining a 
character and an image, and the candidate list display means 2022 displays the image 
data in the item of the list. 

[0026] The Emoji-symbol retrieval means 203 obtains data which is currently selected 
by the candidate list display means 2022 (in the case of Fig. 8(b), the bitmap of wine and 
the declensional Kana ending "ft") and obtains a character string of a non-target phrase, 
that is, a character string of a phrase which is not to be converted, from the candidate 
character string storage means 2031 (in the case of Fig. 7, the phrase "3oV^ LV 
The context of the phrases stored in the phrase information storage means 2032 is 
examined, and correct conversion candidate characters are displayed on the 
character/image display means 202 1 . When there is only a Kanji character, "M ft" and 
"3o V b V v ' are combined and displayed as shown in Fig. 8(b). When an image is 
included, an image of wine, "ft" and "£3V> LV v ' are successively displayed as shown 
in Fig. 8(b). 

[0027] The conversion candidate list is in the form of a table which is formed by items 
having a mode and two data regions. In the following example, the items have Kanji 
data when the mode value is 0, and have a bitmap file name when the mode value is 1. 
No data is set in the second region when the mode value is 0. Even when the mode 
value is 1, no value is set in the second region if there is no declensional Kana ending. 

o Ztfft 

o mft 

0 Mft 

1 sake.gif^S 
1 wine.gif ft 

The candidate list display means 2022 checks the mode value, and when the mode value 
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is 1, leaves a display of the item to the image/character combination display means 2023 . 
[0028] Although the embodiments of the present invention have been described in detail 
with reference to the accompanying drawings, the specific structure is not limited to the 
embodiments, and design modifications and the like, which are made without departing 
from the subject matter of the present invention, are included in the present invention. 



